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Abstract 

This study investigates the influence of lattice structure in evolutionary games. The snowdrift 
games is considered in networks with high clustering coefficients, that use four different strategy¬ 
updating. Analytical conjectures using pair approximation were compared with the numerical 
results. Results indicate that general statements asserting that the lattice structure enhances 
cooperation are misleading. 
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I. INTRODUCTION 


Evolutionary games in complex networks have recently attracted attention in evolutionary 
biology, behavioral science and statistical physics |l-3|. One of the most important questions 


in these fields is how network structure affects the evolution of cooperative behavior 


0 . 


B- 


Nowak and May noted that the lattice structure enhances cooperative behavior in the 


prisoner’s dilemma game 
that support cooperation 


Currently lattice structure is considered one of the mechanisms 
ll. Ildl. However, Hauert and Doebeli found that lattice structure 

nn 

often inhibits cooperative behavior in the snowdrift game [ll|,|12]. Thus, it is not clear how 
lattice structure affects the evolution of cooperation in general situation. Lattice structure 
are characteristically predisposed to high clustering. The purpose of this study was to 
establish a theoretical formula that describes the influence of the clustering coefficient in 
evolutionary games. Moreover, the effects of the lattice structure, have been clarified The 
pair approximation technique was applied to obtain an analytical solution HQ. 

The clustering coefficient is used to measure the tendency of nodes in a network to cluster 
together 151]. The clustering coefficient of a single node is defined as the probability that 
two randomly selected neighbors are connected to each other. The clustering coefficient C 
of the entire network is determined by averaging the clustering coefficients of all nodes. For 
many social networks, such as hie actor collaborations jQ, telephone calls 16], e-mails 17], 
sexual relationships 18|, and citation networks [IQ], the clustering coefficients are greater 
than those of randomly established networks. Although several studies have examined the 
effects of clustering on the organization of cooperation jg, 9], there is little agreement as to 
whether clustering promotes or inhibits the evolution of cooperation. This study considers 
models with four different strategy-updating rules and presents analytical predictions. 


II. MODELS 

Consider a static network with n nodes. An individual occupies each node. Individuals 
play games with all neighbors and their reproduction depends on the average payoff of a 
sequence of games. The snowdrift game is considered as an example. An individual chooses 
one of the two strategies: cooperation (C) or defection (D). The payoff matrix is given by 
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where the positive parameters b and c represent the benefit and cost of cooperation, respec¬ 
tively. The cost-to-benefit ratio of mutual cooperation is defined by r = c/(2b — c). When 
r < 1 (i.e., b > c), the snowdrift game has an inner Nash equilibrium, where the cooperator 
frequency is 1 — r. In this case, the two strategies coexist in a well-mixed population. This 
type of game is also known as the hawk-dove or chicken game. 

Next, the networks on which this evolutionary game is performed are defined. All notes 
were assumed to have same degree z (the number of neighbors) to focus on the network clus¬ 
ter coefficient effects. We used a random regular graph with a high clustering coefficient. 
The edge exchange method [21] that selects two links randomly and repetitively was used 
to construct the graph. The links were rewired only when the new network configuration 
was connected and had a larger clustering coefficient. In addition, three types of regular 
lattices with periodic boundary conditions were used: square lattice with von Neumann 
neighborhood (z = 4), hexagonal lattice (z = 6), and square lattice with Moore neighbor¬ 
hood (z = 8). The clustering coefficient C is calculated as zero for the von Neumann lattice, 
although it is highly clustered. 

The strategy was assumed to be updated stochastically and asynchronously. These are 
natural assumptions because strategy selection is not deterministic and occurs simultane¬ 
ously in the population. Four different strategy-updating rules were selected [71, 111 ]. 


1. Birth-death (BD). Choose an individual i with probability proportional to its fitness 
/j. Then, choose another individual j among the neighbors of individual i. Individual 
j adopts the strategy of individual i. 

2. Death-birth (DB). Choose an individual i at random. Then, choose another individual 
j among the neighbors of individual i with probability proportional to fitness fj. 
Individual i adopts the strategy of individual j. 

3. Imitation (IM). Choose an individual i at random. Then, choose another individual 
j among individual i and its neighbors with probability proportional to its fitness. 
Individual i adopts the strategy of individual j. 
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4. Local competition (LC). Choose an individual i at random and then choose another 
individual j among its neighbors randomly. Individual j adopts the strategy of indi¬ 
vidual i with probability /*/(/* + fj). 


The fitness /* of individual i is given by 1 — w + wPi, where R is the average payoff of 
all its neighbors. The parameter w is the intensity of selection [l, 7\. We assumed a weak 
selection with small w. This weak selection assumption allowed the pair approximation to 
be performed analytically within reason of what occurs in the biological world. 


III. ANALYTICAL PREDICTIONS 


A pair approximation was used to calculate the equilibrium state. Let pc and po be 
the densities of cooperators (C) and defectors (D), respectively. The pair densities taken 
into consideration p C c, Pcd and Pdd represented the frequency that two neighboring pairs 
were CC, CD or DD. Pairs CD and DC were not distinguished from each other. Thus, 
Pcc + Pdd + Pcd = 1- The conditional probabilities pc\c and Pd\d is given by 

Pc\c = Pcc / Pci Pd\d = Pdd/Pd- (2) 


Considering p c = pcc + Pcd/ 2 and p D = p DD + p C d/ 2, the densities p c , Pd, Pcc, Pcd and 
Pdd are represented as functions of pc\c and Pd\d- 


Pc 

Pd 

Pcc 

Pcd 

Pdd 


1 — Pd\d 
2 - pc\c ~ Pd\d ’ 

1 ~ Pc\c 

2 — Pc\c ~ Pd\d' 
Pc\c{^-Pd\d) 

2 - pc\c ~ Pd\d ’ 

2(1 -pcic)(l ~Pd\d) 
2 - pc\c ~ Pd\d 
Pd|d(1 ~ Pc\c) 

2 — Pc\c ~ Pd\d 


(3) 


A triplet, which includes three nodes, can be one of two different configurations. The triad 
has a node connected with two other nodes that do not connect with each other. The 
triangle configuration is when all three nodes connected. The standard pair approximation 
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for a triad 


leads to 


Pzccd 

Pzcdd 


PccPcd 
2 Pc 

PddPcd 


2 Pi 


D 


However, the use of an extended pair approximation m for a triangle provides 


Q 


Paccd ■ Pacdd 


PccPcdPcd PcdPcdPdd 


Pc\c ■ Pd\d- 


PcPcPd PcPdPd 

The hrst approximate equality was calculated from the Kirkwood superposition approxima¬ 


tion 


221 . [23 ]. Therefore, we obtained 

PC\CD ~ (1 - C)pc\c + C 
Pd\dc ~ (1 — C)pd\d + C 


Pc\c 


Pc\c + Pd\d 
Pd\d 


(4) 


Pc\c +Pd\d ’ 

where C represents the clustering coefficient, Pc\cd is the probability that a neighbor of the 
end cooperator of a CD pair is a cooperator, and Pd\dc is the probability that a neighbor 
of the end defector of a CD pair is a defector. 

A cooperator can become a defector only when at least one defector exists in the neighbor¬ 
hood of the cooperator, and vice versa for all four strategy-updating rules Thus, a strategy 
can be replaced only in CD pairs. In the strategy-updating cases of BD and LC, the prob¬ 
ability to choose C among a CD pair is proportional to the average fitness 


1 _ w + w[b - c + -(1 - 1 / z)pc\cd\, 
while the probability to choose D is proportional to 

1 - w + w[b - b(l - l/z)p D \ DC ]. 


(5) 


( 6 ) 


The necessary condition for equilibrium is that (J5]) equals to ]6]). This condition is simplified 


as 


c c 

2 Pg\cd + b Pd\dc = j _ l j z 

If eq. (ED is correct, the strategy changing rates coincide with each other: 


P, 


C^-D 


= P, 


D^C- 


(7) 


( 8 ) 


In addition, in the equilibrium state, the rate at which CD pairs become CC needs to 
equal the rate at which CC pairs become CD. The rate of change of the doublet density is 
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cost-to-benefit ratio: r 


FIG. 1. The density p c of cooperators plotted as a function of the cost-to-benefit ratio r = c/(2b—c) 
for four different updating rules. The clustering coefficient was set to C = 0, 0.25, and 0.5 for fixed 
z = 4 and w = 0.5. The system size was 10,000. In all simulations, p c was obtained by averaging 
the last 10,000 time steps after the first 10,000 ones, and each point resulted from 10 different 
realizations. The lines represent the predictions (1121) for BD and LC, (1131) for DB, and (1141) for IM. 


given by 


Since P ( 


CD^CC 


Pcd^cc — [1 + — 1)(1 — Pd\dc)\Pd-+c 

Pcc^cd = {z — P)Pc\cdPc^d- 

= Pcc^-cd and eq. (J8]), another condition is 


(9) 

( 10 ) 


Pc\cd + Pd\dc — 


z-1 


( 11 ) 


Solving the system of eqs. (J7J) and (TTlT) . yields the equilibrium solutions of Pc\cd and Pd\dc- 
Using d3J) and (pfj), the cooperator equilibrium density was calculated as 


z-C(z-l) ( 1 

P' = - z -2-C(z-l) \ ~ 2 


1 

2 ' 


( 12 ) 


The result (jT2]) is valid for BD and LC. 
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cost-to-benefit ratio: r 


FIG. 2. The density p c of cooperators plotted for four different updating rules. The degree was 
set to 2 = 4, 6 and 8 for fixed (7 = 0 and w = 0.5. Lines represent predictions (fT2|) for BD and 
LC, (1131) for DB, and (|14l) for IM. Other parameter values are the same as in Fig. |T] 

It is more complicated to obtain a pair approximation that involves the effect of triangles 
in the case of DB and IM updating The condition dll]) is also valid in these cases. The 
following are conjecture equations 

[z-C(z-l)\(z-l) ( r _l_ 1 

Pc [z-2-C(z- l)](z + l) V 2 z-l) 2 

for DB updating, and 

= [z-C(z- l)](z- 1) 

Pc [z~2-C(z-l)](z + l) 

for IM updating. Although eqs. (Il3l) and (TT4l) can be calculated by analogy with (1T21) . proper 

deviation do not exist yet. 


1 

r ~ 2 _ {z + 2)(z-l) 


+ 


(14) 



IV. NUMERICAL RESULTS 


To confirm the predictions presented in the previous section, numerical results were per¬ 
formed for random networks with high clustering coefficients (Figs. [Hand [2]). The predictions 
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cost-to-benefit ratio: r 


FIG. 3. The density p c of cooperators plotted for four different updating rules. The simulations 
were performed for the von Neumann square lattice (z = 4), hexagonal lattice (z = 6) and Moore 
lattice (z = 8). Reference lines are superimposed (fliZl) for BD and LC, (fTHD for DB, and ([HD for 
IM, where the clustering coefficient C was set to C = 0.5 for the von Neumann square lattice, 
C = 0.65 for the hexagonal lattice, and C = 0.7 for the Moore lattice. Other parameter values are 
the same as in Fig. Q] 

agree well with the numerical results. Figure [Q shows that when the clustering coefficient 
increases, the frequency of the major strategy increases for all four updating rules. Pre¬ 
dictions m, (Hi, and (HIP suggest the interval of the coexisting region is [z — 2 — C(z — 
l)]/[z — C(z — 1)] for BD and LC, and {[2 — 2 — C(z — l)](z + 1 )}/{[* — C(z — l)](z — 1)} 
for DB and IM. Thus, if C > (z — 2)/(z — 1) the only one strategy can survive for all four 
updating rules. Figure [2] shows that the frequency of the majority increases when the degree 
z decreases for BD and LC updating rules. Cooperation is enhanced for small z for DB and 
IM updating rules. 

Figure E] shows numerical results for three types of two-dimensional lattices. The predic¬ 
tions (jT2]) for BD and LC, (1T3|) for DB, and (fHj) for IM, were superimposed for reference 
where the parameters were set as z = 4 and C = 0.5 for the von Neumann lattice, z — 6 and 
C = 0.65 for the hexagonal lattice, and z = 8 and C = 0.7 for the Moore lattice in Fig J3J 
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This result suggests that the ‘effective’ cluster coefficients are approximately 0.5, 0.65, and 
0.7 rather than the “nominal” values 0, 0.4, and 0.43. The clustering coefficient measures 
the density of triangles in a network. This deviation is because of the effect of loops of 
length four and above. Cooperator density increases when the degree z decreases for DB 
and IM updating rules. 


V. DISCUSSION AND CONCLUSION 


In conclusion, the frequency of the majority increases with the clustering coefficient. In 
situations where cooperators and defectors coexist and cooperators are the majority, cluster¬ 
ing enhances cooperative behavior. When cooperators are the minority where cooperators 
and defectors coexist, clustering inhibits cooperative behavior. These results are indepen¬ 
dent of the str ateg y-updating rule. We can explain this tendency intuitively by using the 
heterophilicity 24] as follows. From eqs. ((3]) , (J5J) and (fTTTh the heterophilicity 24] is calcu¬ 
lated as 

H:= _P£d_ = 1_ - 1 - (15) 

2 PcPd (z — 1)(1 — C) 

for all four updating rules. It is obvious H < 1, meaning that C have more connections 
to D than expected randomly. When the clustering coefficient C increases, heterophilicity 
H decreases. In this case, the population is more exclusive, and it is more difficult for 
strategies to coexist. Consequently, the parameter region where two strategies can coexist 
becomes narrow. We performed numerica 
scale-free network on geographical space 


simulations for a small world network [15j| and a 


25J (not shown) to confirm the generality of this 


result, Essentially the same results were obtained. Unfortunately, a rigorous derivation of 
A3 and (fT4li is not provided and it remains an open problem. 


Lastly, we considered the prisoner’s dilemma game, where the payoff matrix is 


id] 



(16) 


In this case, mutual defection is the only strong Nash equilibrium, regardless of the values 
of the parameters b and c. Thus, only defectors can survive in well-mixed population. In 
addition, cooperators cannot survive for BD and LC updating rules. The standard pair 
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approximation for the DB updating rule shows if b/c > z, only cooperators can survive; 
conversely, if b/c < z, only defectors can survive fj. The result is the same in the case of 
IM updating, except the threshold is b/c = z + 2. In any case, there is no parameter region 
where the two strategies can coexist. Thus, the clustering coefficient has no influence on 
the density of cooperators in the prisoner’s dilemma game. In conclusion, the assertion that 
lattice structure enhances cooperative behavior is misleading. 


ACKNOWLEDGMENTS 

This work was supported by Grant-in-Aid for Scientific Research (No. 26400388) and 
CREST, JST. Some of the numerical calculations were performed on machines at the YITP 
of Kyoto University. 


[1] M. A. Nowak, Evolutionary Dynamics: Exploring the Equations of Life Harvard University 
Press, Cambridge, 2006. 

[2] E Lieberman, C Hauert, MA Nowak, “Evolutionary dynamics on graphs,” Nature 433 , pp. 
312-316, 2005. 

[3] Gyorgy Szabo, Gabor Fath, “Evolutionary games on graphs,” Physics Reports 446, pp. 97- 
216, 2007. 

[4] M.A. Nowak and R.M. May, “Evolutionary games and spatial chaos,” Nature 359 , 826-829, 
1992. 

[5] M.A. Nowak and K. Sigmund, “Evolutionary Dynamics of Biological Game,” Science 303 , 
763-799 (2004). 

[6] H. Ohtsuki, C. Hauert, E. Lieberman, M. A. Nowak, “A simple rule for the evolution of 
cooperation on graphs and social networks,” Nature 441, pp. 502-505, 2006. 

[7] Hisashi Ohtsuki, Martin A Nowak, “Evolutionary games on cycles,” Proc. R. Soc. Lond., B, 
Biol. Sci, 273 pp. 2249-2256, 2006. 

[8] S. Assenza, J. Gomez-Gardenes, and V. Latora, “Enhancement of cooperation in highly clus¬ 
tered scale-free networks” Phys. Rev. E 78 , 017101, 2008 


10 




[9] M. N. Kuperman and S. Risau-Gusman, “Relationship between clustering coefficient and the 
success of cooperation in networks” Phys. Rev. E 86, 016104, 2012 

[10] M. A. Nowak, “Five rules for the evolution of cooperation” Science 314 , pp. 1560-1563, 2006. 

[11] Ch. Hauert and M. Doebeli, “Spatial structure often inhibits the evolution of cooperation in 
the snowdrift game,” Nature 428 , pp. 643-646, 2004. 

[12] M. Doebeli and Ch. Hauert, “Models of cooperation based on the Prisoner’s Dilemma and the 
Snowdrift game,” Ecol. Lett. 8, pp. 748-766, 2005. 

[13] K. Sato, H. Matsuda and A. Sasaki, “Statistical Mechanics of Population,” Prog. Theor. Phys. 
88, pp. 1035-1049, 1992. 

[14] S. Morita, “Extended Pair Approximation of Evolutionary Game on Complex Networks” Prog. 
Theor. Phys. 119 , pp. 29-38, 2008. 

[15] D. J. Watts and S. Strogatz, “Collective dynamics of ’small-world’ networks,” Nature 393, 
pp. 440-442, 1998. 

[16] W. Aiello, F. Chung, and L. Lu, “A random graph model for massive graphs in Proceedings,” 
the 32nd Annual ACM Symposium on Theory of Computing, pp. 171-180, Association of 
Computing Machinery, New York, 2000. 

[17] K. Ebel, L. -I. Mielsch and S. Bornholdt, “Scale-free topology of e-mail networks,” Phys. Rev. 
E 66, 035103, 2002. 

[18] F. Liljeros, C. R. Edling, L. A. N. Amaral, H. E. Stanley and Y. Aberg, “The web of human 
sexual contacts,” Nature 411 , pp. 907-908, 2001. 

[19] S. Redner, “How popular is your paper? An empirical study of the citation distribution,” 
Eur. Phys. J. B 4, pp. 131-134, 1998. 

[20] H. Christian, M. A. Nowak, and K. Sigmund, “Evolution of extortion in Iterated Prisoner’s 
Dilemma games,” Proc. Natl. Acad. Sci. USA 110 , pp. 6913-6918, 2013. 

[21] B. J. Kim, “ Performance of networks of artificial neurons: The role of clustering,” Phys. Rev. 
E 69 , 045101(R), 2004. 

[22] J. G. Kirkwood, “statistical mechanics of fluid mixtures,” J. of Chern. Phys. 3, pp. 300-313, 
1935. 

[23] H. Matsuda, “physical nature of higher-order mutual information: Intrinsic correlations and 
frustration,” Phys. Rev. E 62 , pp. 3096-3102, 2000. 


11 


[24] J. Park and A. -L. Barabasi, “Distribution of node characteristics in complex networks,” Proc. 
Natl. Acad. Sci. USA 104 , pp. 17916-17920, 2007. 

[25] S. Morita, “Crossovers in scale-free networks on geographical space,” Phys. Rev. E 73 , 035104, 
2006. 


12 


